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Abstract 

We present a neurobiologically-inspired stochastic cellular automaton 
r ) ' whose state jumps with time between the attractors corresponding to a 

series of stored patterns. The jumping varies from regular to chaotic 

as the model parameters are modified. The resulting irregular behavior, 

Q ' which mimics the state of attention in which a systems shows a great 

adaptability to changing stimulus, is a consequence in the model of short- 
time presynaptic noise which induces synaptic depression. We discuss 
^^, results from both a mean-field analysis and Monte Carlo simulations. 
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^ , 1 Introduction 

O , 

rs^ I Analysis of electroencephalogram time series, though perhaps not conclusive 

^^ . yet, suggest that som e of the brain high level tasks might require chaotic ac- 

■^ ■ tivity an d itinerancy dBarr ie et all Il996t IXsudal. l200lt iKorn and Faurel 12003 ' 
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^^ . iFreemani 120031) . As a matter of fa ct, following the observation of construc- 

tive chaos in many n atural systems l|Kiel and EUiotL llQQfit iKaneko and TsudaL 
l2001t IStrogatd . 1200,31) , it has been reported some evidence that chaos may, for 
example, enhance sensitivity by inducing a critical state of synch ronization dur- 

,J2 . ing expectation and attention iJHansel and Sompolinskvl Il996f) . and perhaps 

> 

X 



I 



rovide an effic ient means to discriminate different (e.g.) olfactory stimvili 
Ashwin and Timme . 2005) . Consequently, there has recently bee n some effort 
in in c orporating cons t ructive chaos in neural network modeli ng teang-SLalJ 
199ff; Bolle and Vink, 199d: Domingucz and Theumann, 1997; Caroppo et ay 
1999: Poon and Barahona, 2001: Mainicri and Jr., 2002: Katayama ct al.. 2003 



Concl uding on the significance of chaos in neurobiological systems is still an open 
issue teabinovich and Abarbaneill998l:lFaure and KornLl200lUKorn and Faurel 
12003) . however. 
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As a new effort towards better understanding this problem, in the present 
paper we present, and study both analyticaUy and numericaUy, a neural au- 
tomaton which exhibits chaotic behavior. More specificaUy, it shows sort of 
dynamic associative memory, consisting of chaotic hopping between the stored 
memories, which mimics the brain states of attention and searching. The model 
is a neurobiologically inspired cellular automaton, in which dynamics concerns 
the whole, which is simultaneously updated — instead of sequentially updating 
a small neighborhood at each time step. This automaton (or Little dynamics) 
strategy has already revealed efficient in modeling seve ral aspects of associa- 
tive memory l|Gang-ulv et al.L 1200,*^ ICortes et al.L 12004^) . Interesting enough, 
concerning this property, neural automata often exhibit more interesting be- 
havior than their Hopfield-like, sequentially-updated counterparts, in spite of 
the fact that any two successive states are stronger correlated in the sequential 
case. Therefore, we extend here to cellular automata our recent study of the ef- 
fects of synap tic "noise" on the stability of attractors in Hopfield-like networks 
IjCortes et al.[ l200fi'l. We demonstrate that, in our automaton, a certain type 
of synaptic fluctuations determine an interesting retrieval process. The model 
synaptic fluctuations are coupled to the presynaptic activity in such a way 
that synaptic depression occurs. This phenomenon, which has been observed 
in actual systems, consists in a lowering o f the neurotransmitters release af- 
ter a period of intense presynaptic activity iJTsodvks et all Il998l : IPantic et al.L 
|2002|) . Our model fluctuations happen to destabilize the memory attractors 
and are shown to induce, eventually, regular and even chaotic dynamics be- 
tween the stored patterns. Confirming expectations mentioned above, we also 
show that our model behavior implies a high adaptability to a changing environ- 
ment, which seems to be one of the nature strategies for efficient computation 
llT.u et abl Eini lSchweighofer et all 120041 



2 The model 

Let a set of N binary neurons, S={si = ±l;i — 1,...,N}, connected by 
synapses of intensity: 

w^j=w]'jXj, ViJ. (1) 

Here, Xj stands for a random variable, and wf^ is an average weight. The 
specific choice for the latter is not essential here but, f or simplicity and reference 
purposes, we shall consider a Hebbian learning rule (| AmitL Il98ijt) . That is, we 
shall assume in the following that synapses store a set of M binary patterns, 
C^ = Hi = il; i = 1, . . . , N} , fi= 1, ..., M, according to the prescription, it;]^ = 

The set X —{xj} of random variables is intended to model some reported 
fluctuations of the synaptic weights. To be more specific, the multiplicative 
noise in Q , which w as rec ently used to implement a variation of the Hopfield 
model (jCortes et all l2006|) . may have different competing causes in practice, 
ranging from short-length stochasticities, e.g., those associated with the opening 
and closing of the vesicles and with local variations in the neu rotransmitters 
conce ntration, to time lags in the incoming long-length signals l|Franks et all 
l2003j) . These effects will result in short-time, i.e., relatively fast microscopic 
noise. As a matter of fact, the typical synaptic variability is reported to occur on 



a time s cale w hich is small com.pared with the characteristic system relaxation 
IjZadoil Il998|) . Therefore, as far as X corresponds to microscopic fast noise, 
neurons will evolve as in presence of a steady distribution, say P''*(X|S). It 
follows that such noise will modify the local fields, ft.i(S,X) = '^j-a'WijXjSj, 
i.e., the total presynaptic current which arrives to the postsynaptic neuron s^, 
which one may assume to be given in practice by 

MS)- / h,iS,X)P'\X\S)dX. (2) 

Jx 



This, which is a main feature of our automaton, amounts to assume that each 
neuron endures an effective field which is, in fact, th e average contribution o f 
all possible different realizations of the actual field [Bibitchkov ct al., 200^. 
This situation has been for mally discussed in detail in Rcfs. ( Torres et al.. 19971 
iMarro and DickmanL 1 1999(1 . It may be noticed that, consistently with the choice 
of a binary, ±1 code for the neurons activity, we are assuming zero thresholds, 
6i = 0, Vi, in the following; this is relevant when comparing this work with some 
related one, as discussed below. 

Next, one needs to model the noise steady distribution. Motivated by some 
recent neur obiological findings, we would like this to mimic short-term synaptic 
depression l|Tsodvks et al.lll998HPantic et al.U2002() . This refers to the obser- 
vation that the synaptic weight decreases under repeated presynaptic activation. 
The question is how such mechanism may affect the automata (and, in turn, 
actual systems) dynamics. For simplicity, we shall assume factorization of the 
noise distribution, i.e., we assume the simplest case P'''(X|S) = ]^-P(a::j|S), 
and 

Pix,\S)^Cir^) Six,+^) + [l-Cirn)] 6{x,-l). (3) 

Here, rh = m(S) stands for the overlap vector of components to^(S) = N~^ J^i ^i^i 
and C (m) is an increasing function of m to be determined. The choice (|5|) 
amounts to assume that, with probability C (rh) , i.e., more likely the larger rh 
is, which implies a larger net current arriving to the postsynaptic neurons, the 
synaptic weight will be depressed by a factor — <I>. Otherwise, the weight is given 
the chosen average value, see equation (Q. Interesting enough, ^ clearly in- 
duces some non-trivial correlations between synaptic noise and neural activity. 
This is an additional bonus of our choice, as it conforms the general expectation 
that processing of information in a netwo rk will depend on the noise affecting 
the communication lines and vice versa l|Cortes et al.L 1200(11) . Looking for an 
increasing function of the total presynaptic current with proper normalization, 
a simple choice for the probability in |j3Jl is C (m) = (1 + a)~ ^ [m^ (S)] , 
where a = M/N is the load parameter or network capacity. It then follows 
after some simple algebra that the resulting fields are 

MS) - 1 1 - 7 E ["^^ (^)nJ2 ^>'' (s) , (4) 

where 7=(1 + <I>)(1 + q;) . Notice that this precisely reduces for <I> ^ — 1 
to the local fields in the Hopficld model in wh ich the synaptic weights do not 
fluctuate but arc constant in time IjAmiti . 119891) . 

Time evolution is due to competition between these fields, which contain 
the effects of synaptic noise, and some additional natural stochasticity of the 



neural activity. In accordance with a familiar hypothesis, we shall assume this 
stochasticity controlled by a " temperature" parameter, T , which characterizes 
an underlying "thermal bath" l|Marro and DickmanL Il999l) . Consequently, evo- 
lution is by the stochastic equation nt+i(S) = ^g, nt(S')ri(S' — > S), where the 
probability per unit time of a transition is 



N 



n{S'^S)^l[cj{4^s,). (5) 



i=l 



For simplicity and concreteness, we take U!{s'j^ ^ Si) oc Vt [f3i (s^ — Si)] , where 
/3i = T^^hi{S'), and /li(S') independent of s^, which is a good approxima- 
tion for a sufficiently large network (technically, this is an exact property in 
the thermodynamic limit N — > cxs). The function ^ is arbitrary except that, 
in order to obtain well defined limits, we require that ^(u) = \l/(— u) exp(u), 
^(0) = 1 and \['(oo) = 0, which holds for a normalized exponential function 
IjMarro and DickmanL Il999ll . Then, consistent with the condition ^g r2(S' -^ 
S) = 1, we take 

u:{s[ ^ s,) = nP^{s[ - s,)] [1 + ^ (2AsO]"' . (6) 

3 Main results 

It is obvious that t he ab ove may be adapted to cover other, more involved 
cases ijCortes et all 120061) . but this is enough to our purposes here. In fact, 
Monte Carlo simulations reveal s ome new interesting facts as compared with 
the case of sequential updating l|Cortes et all l200(J) . To begin with, figure 
n illustrates a much varied landscape, namely, the occurrence of fixed points, 
cycles, regular and irregular hopping between the attractors. This m ay also 
be ob tained analytically in the mean-field approximation Si = (si) Vi IJAmitl . 
Il989() . We then obtain for Af = 1 a discrete map which describes time evolution 
of the overlap m = m^ as 

mt+i=tSinh{T-^mt[l-m^{l + <P)]}. (7) 

As one varies here the "temperature" T and the depressing parameter <I>, it 
follows a varying situation in perfect agreement with the Monte Carlo simula- 
tions, as one should have expected for a fully connected network. In particular, 
figure El shows the occurrence of chaos in a case in which thermal fluctuations 
are small compared to the synaptic noise. That is, the Lyapunov exponent. A, 
corresponding to the dynamic mean-field map shows different chaotic windows, 
i.e., A > 0, as one varies $ for a fixed T. As illustrated also in figureEl dynamics 
is stable for <I> = — 1, i.e., in the absence of any synaptic noise, and the only 
solutions then correspond to the ones that characterize the familiar Hopfield 
case with parallel updating. As <f> is increased, however, the system tends to 
become unstable, and transitions between to = 1 and m = —1 then eventually 
occur that are fully chaotic. 

There is also chaotic hopping between the attractors when the system stores 
several patterns, i.e., for M > 1. In this case, we obtain the more complex, 
multidimensional map: 

TO''(S)(i + 1) - ^ E ^"^ tanh[/37^(S)(i)] Vz. = 1, . . . M. (8) 



This is to be numerically iterated. The simplest order parameter to monitor 

this is: 

c = T^E(™'(s)f . (9) 

1 + a ^—' 

This is shown in figure|31as a function of $. The graph clearly illustrates a region 
of irregular behavior which has a width A<f>c defined as the distance, in terms of 
$, from the first bifurcation to the last one. Interesting enough, we find that the 
width of this region is practically independent of the number of patterns; that 
is, we find that A$c = 0.575±0.005 as M is varied within the range M e [1, 50] . 
This suggests that the chaotic behavior which occurs for depressing fast synaptic 
fluctuations, i.e., for any $ > — 1, does not critically depend on the automaton 
capacity but the model properties are rather robust and perhaps independent of 
the number of stored patterns within a wide range. One may expect, however, 
that some of the interesting model properties will tend to wash out as the load 
parameter increases macroscopically, i.e., as M — > oo. 



4 Discussion and further results 

Motivated by the fact that analysis of brain waves provides some indication 
that the chaos-theory concept of strange attractor may be relevant to describe 
some of the neural activity, we presented here a neurobiologically-inspired model 
which exhibits chaotic behavior. The model is a (microscopic) cellular automa- 
ton with only two parameters, T and $, which control the thermal stochasticity 
of the neural activity and the depressing effect of (coupled) fast synaptic fluc- 
tuations, respectively. Our system reduces to the Hopfield case with Little 
dynamics (parallel updating) only for $ = — I. 

Our main result is that, as described in detail in the previous section, the 
automaton eventually exhibits chaotic behavior for $ ^ —1, but not for <f> = — I, 
nor i n the case of sequen tial, single-neuron updating irrespective of the value 
of $ IjCortes et al.[ l2nnfi|) . It also follows from our analysis above that further 
study of this system and related automata is needed in order to determine 
other conditions for chaotic hopping. For example, one would like to know 
if synchronization of all variables is required, and the precise mechanism for 
moving from regular to irregular behavior as $ is slightly mod ified. We are 
pursuing the present effort along this line l|Cortes et all l200d) . and present 
some related preliminary conclusions below. 

This is not the first time in which chaos is reported to o ccur during the re- 
trieval process i n attractor neural networks; see, for i nstaii c e. (IWang et allll99C ; 



Bolle and Vinkl. Il99a iD ominguez and Theuman nl Il997t IPoon a nd Barahona , 
bnniUCaronpo et allll999HMainieri and ,Trll2nn2llKatavama et all l2003V One 
may say, however, that we provide in this paper a more general and microscopic 
setting than before and, in fact, the onset of chaos here could not be phe- 
nomenologically predicted. That is, the same microscopic mechanism, namely 
([Hi and (O, does not imply chaotic beha vior if updating is by a sequential 
single-variable process IjCortes et all 120061) . Another possible comparison is by 
noticing that, in any case, whether one proceeds more or less phenomenologi- 
cally, the result is a map tti^+i = G{mt). We obtained the gain function G after 
coarse graining of Q-JHl, and the Monte Carlo simulations fitting the map be- 
havior just involve neurons subject to the local fields Q, so that we are only 



left in the two cases with the noise parameter $ to be tuned. In contrast, some 
related works, in order to deepen more directly on the possible origin of chaos, 
use the gain function itself as a par ameter. It is also remar kable that, e.g. 



toomingu ez and TheumannL 19971) and some rel ated work ijCaroppo et all 



m (IJJom mguez and Iheumannl li^^ (|i and some rel ated v 

I1999I: iMainieri and ,Tr.L l2002t iKatavama et all l200.ll) , the gain function is phe- 
nomenologically controlled by tuning the neuron threshold for firing, di. The 
threshold function thus becomes a relevant parameter, and it ensues that any 
meaningful chaos in this context requires non-zero threshold. This is because, 
in these cases, the local fields and, consequently, the overlaps, are lineal, which 
forces one to induce chaos by other means. Interesting enough, our gain function 
in has either a sigmoid shape or an oscillating one, as illustrated for T = 
in figure 21 Only the latter case allows for hopping between the attractors and, 
eventually, for chaotic behavior. 

Finally, we demonstrate an interesting property of our automaton during 
retrieval. This is the fact that, in the chaotic regime, the system is extremely 
susceptible to external influences. A rather stringent test of this is its behavior 
concerning mixture or spin-glass steady states, which are unsuited in relation 
with associative memory. Even though these states may occur at low T, this 
system — unlike other cases — easily escapes from them under a very small 
external stimulus. This is illustrated in figure which also demonstrates a 
general feature, namely, some strong correlation between chaos and a vivid 
response to the environment. This nicely conforms expectations mentioned 
above, in the introduction of this paper, that chaotic itinerancy might be a 
rather general strategy of nature. 
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Figure Captions 

Figure 1: Monte Carlo time-evolution of the overlap between the automaton 
current state and the given stored pattern for ill = 1, A^ = 10 neurons, T — 0.1, 
and different values of $, as indicated. This illustrates, from top to bottom, 
the fixed point solution in the absence of any synaptic noise, i.e., $ = — 1, a 
cyclic behavior, the onset of irregular periodic behavior, and fully irregular and 
regular jumping between the two attractors corresponding, respectively, to the 
given pattern, m = m} — 1, and its anti-pattern m = —1 — the only possibili- 
ties in this case with M — 1. 

Figure 2: Bifurcation diagram and associated Lyapunov exponent demonstrat- 
ing chaotic activity for some (but not all) values of the depressing coefficient 
$. The upper graph shows, for M = 1, the steady overlap between the cur- 
rent state and the given pattern as a function of $. This is from Monte Carlo 
simulations of a network with A^ — 10^ neurons. The bottom graph depicts 
the corresponding Lyapunov exponent. A, as obtained from the map 0. This 
confirms the existence of chaotic windows, in which A > 0. The temperature 
parameter is set T = 0.1 in both cases; this is low enough so that the effect of 
thermal fiuctuations is negligible compared to that of synaptic noise. 

Figure 3: The function ( ($) , as defined in the main text, obtained from 
Monte Carlo simulations at T = 0.15 for N = 10'* neurons and M — 20 stored 
patterns generated at random. A region of irregular behavior which extends for 
A$c, as indicated, is depicted. The insets show the time evolution of four out 
of the 20 overlaps within the irregular region, namely, for <f> — 0.11. 

Figure 4: The gain function in versus mt for T = and different val- 
ues of $, as indicated. It is to be remarked that this function is non-sigmoidal, 
namely, oscillatory, which allows for hopping between the attractors for $ > 0, 
while it is monotonic in the Hopficld case $ = — 1. 

Figure 5: Time evolution of the overlap m'' in a Monte Carlo simulation with 
N —W^ neurons, M = 4 stored (random) patterns, T = 0.05, and, from top 
to bottom, $ — —0.2, —0.1, 0.12, and 0.2. This illustrates that, under regular 
behavior (as for the first two top graphs and the bottom one), the system is un- 
able to respond to a week external stimulus. This is simulated as an extra local 
field, /if t = (5^f , where S = 0.05 and ^l changes {^l = 1, 2, 3, 4, 1) every 40 MCS 
as indicated by P^, above the top graph. The situation is qualitatively different 
when the regime is chaotic, as for $ = 0.12 in this figure. After some wandering 
in the evolution that we show here, the system activity is trapped in a mixture 
state around t = 80 MCS. However, the external stimulus induces jumping to 
the more correlated attractor, and so on. That is, chaos importantly enhances 
the network sensitivity. To obtain a similar behavior during the regular regimes, 
one needs to increase considerably the external force S. 
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